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I 

Abstract 

We consider powers of random matrices with independent entries. Let Xij > 1, 
be independent complex random variables with EX^ = and E |Xy P = 1 and let X 
denote annxn matrix with [X]y = Xij, for 1 < i, j < n. Denote by s^™' > . . . > si™'' 
the singular values of the random matrix W :— n~"2"X'" and define the empirical 
distribution of the squared singular values by 

n 
k=l 

where I{b} denotes the indicator of an event B. We prove that under a Lindeberg 
condition for the fourth moment that the expected spectral distribution Fn^\x) = 
E converges to the distribution function G'^'"^(a;) defined by its moments 

/ \ f k 1 \ 1 f ^""^ + k\ 
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1 Introduction 

Let Xij,i,j > 1, be independent complex random variables with EXjj = and E = 
1 and X is an n X n matrix with [X]jj = Xij, for I < i, j < n. Denote by s^™^ > ■ ■ ■ > 
Sn'"'* the singular values of the random matrix W := n~"2"X™ and define the empirical 
distribution of its squared singular values by 

k=l 

where II{-B} denotes the indicator of an event B. We shall investigate the convergence 
of the expected spectral distribution F^\x) = EJ^i,™^(x) to the distribution function 
q{^){x) defined by its moments 

The sequence afc(?n) consists of the so-called Fuss-Catalan Numbers. This sequence defines 
a distribution with Stieltjes transform s^'^\z) satisfying the equation ()1.4p below. We 
consider the Kolmogorov distance between the distributions F^\x) and G^'^\x), that is 

A(r) :=sup|F(-)(x)-G(-)(x)|. 

X 

The main result of this paper is the following 

Theorem 1.1. Let EXjfc = 0, E I-'^jTcP = 1, E I-'^jTcI^ < M < oo. Assume that for any 
r > 

1 " 

Lnir) := — X] ^ \Xjk\'^I{\Xjk\ > Ty/^} ^0 as n ^ oo, (1.1) 

^ j,k=l 

where I{E} denotes indicator of an event E. Then, for any fixed m > 2, 

lim sup \Fj{^\x) - G'^"'\x)\ = 0. 

Corollary 1.1. Let Xj^ are independent identically distributed complex random variables. 
Let 

EXjk = 0, E \Xjkf = 1, E \Xjk\^ = M <oo (1.2) 
Then, for any fixed m>2, 

lim A^,'") = 0. 

n— >oo 

Oravecz in 2001, [6j, studied the so called T^-elements introduced by Voiculescu and 
has shown that the m-th powers of these elements have a distribution whose moments are 
Fuss-Catalan numbers. These numbers satisfy the following simple recurrence relation 

m. 

ak{m)= ^ n^^'-^"^^- ^^-^^ 

fcoH \-km=k-l u=0 
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Denote by s^"^\z) the Stieltjes transform of the distribution with moments Qfc(m). Using 
equaHty (jl.Sp . we may show that the Stieltjes transform s^"^\z) satisfies the equation 

1 + + (-l)™+iz™(s("*)(z))™+i = 0. (1.4) 

Distributions with such a Stieltjes transform belong to the class of the so-called Free Bessel 
Laws which are described in Banica and others [3]. This distribution has been studied 
also in . Using Free probability theory it is possible to prove the result of Theorem 11.11 
for random matrices with independent entries, provided that all moments of X are finite. 
See for instance, Mingo and Speicher [7], and T. Banica and others [3]. Theorem 11.11 was 
formulate in [2]. In [1] we gave a proof of Theorem 11.11 bv the method of moments. Here 
we present a proof of Theorem 11.11 using Stieltjes transforms. This approach allows us 
to get some bound of the rate of convergence. Our proof of Theorem 11.11 is based on the 
representation p.4p . We shall investigate the Stieltjes transform s^\z) of the distribution 
function Fn"^\x) and we shall show that s^\z) satisfies an equation 

1 + ZS^^\z) + {-ir+^z"'{s^^\z)r+^ = 6n{z) 

with some function 6n{z) — t- as n — t- oo. From these two relations we get that sIt^\z) 
converges to s^'^\z) uniformly on any compact set in the upper half-plane /C C . The 
last claim is equivalent to weak convergence of the distribution functions Fj{"\x) to the 
distribution function F^"^\x). 

2 Auxiliary results 

In this Section we describe a symmetrization of one-sided distributions and a special repre- 
sentation of the symmetrizing distribution of squared singular values of random matrices. 
Furthermore, we shall modify the random matrix X by truncation of its entries. By con- 
dition (ll.2p .we get r~''L„(r) — )■ 0), for any r > and that for any q > the function 
T~^Ln{T) is not increasing in r. This implies that we may choose a sequence of positive 
numbers t„ > 0, n = 1, 2 . . . such that 

Tn — )• 0, and Lnir) < r^, as n — )• oo. (2-1) 

2.1 Truncation 

We call the matrix X the truncation of X if 

fx,,, if|X,,|<r„V^ . (2.2) 
I 0, otherwise 

Denote by sj™^ > ■ ■ ■ > s^n^^ the singular values of the random matrix W := n~"2"X™ and 
define the empirical distribution of its squared singular values (eigenvalues of the matrix 
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V = WW*) by fT\x) = }^Trk=imr? < ^l- Let F^^x) = BFrix). It is 
straightforward to check that 



j,k=i 

< 4t E E \X,,\'I{\X,,\ > r„V^} = < rl (2.3) 
" '^'^ j,k=i ^'^ 

Introduce the matrices X := X - E X and W = X"* and V = WW*. Let fIT'^ by the 

empirical distribution of its eigenvalues (squared singular values of W) and -F^™^ = E . 
Let ^^"^^(z) denote the Stieltjes transform of F^\ Introduce the resolvent matrices 

R=(V-zI)~\ and R = (V - zI)-\ (2.4) 

We have 

3<"*)(z) = -ETVR and ?„(z) = -ET>R. (2.5) 

n n 

Applying the resolvent equality 

(A + B - zl)-^ = (A - zl)-^ - (A - zI)-^B(A + B - zI)-\ (2.6) 

we get 

|il™)(z)-5<™)(z)| < iE|TrR(V-V)R|. (2.7) 

n 

Using that TrR(V — V)R = Tr(V — V)RR and applying Holder's inequality, we obtain 

\'^^\z)-s^^\z)\ < ^L^E^||W-W||i(E5||wf + E^||wf). (2.8) 

By definition of the matrices W and W, we get 

m—l 

W - W = ^ X'^(X - X)X'"-i-^ (2.9) 

u=0 

This implies that 

m—l 

||W - W||2 < m ^ ||X - X||^||X^X™-i-'^||^. (2.10) 

1^=0 

Applying Lemma |5.H we obtain 

E ||W - W\\l < Cn||EX||| < ^L„(r„) < Cn'^. (2.11) 
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Inequalities ()2.1ip and (|2.8p together imply 



s<-)(z)-s<r)(z)i< 



c 



(2.12) 



Now we conclude that 



lim sup|F^™) - G^'^\x)\ = lim supjEF^"^) - G^"'\x)\. 




In the what follows we may assume without lost of generality that 



BXjk = 0, E iXjkl"^ = 1, and \Xjk\ < TnVn, 



(2.13) 



for some r„ > such that r„ — )• 0, Ln{Tn) < as n — )• oo. 
2.2 Symmetrization 

We shall use the following "symmetrization" of one-sided distributions. Let be a positive 
random variable with distribution function F{x). Define ^ := where e a Rademacher 
random variable with Pr{e = ±1} = 1/2 which is independent of ^ . Let F{x) denote the 
distribution function of ^. It satisfies the equation 



We shall apply this symmetrization to the distribution of the squared singular values of 
the matrix W. Introduce the following matrices 



Here and in the what follows A* denotes the adjoined (transposed and complex conju- 
gate) matrix A and denotes the unit matrix of order k. Note that V is a Hermitian 
matrix. The eigenvalues of the matrix V are — si, . . . , — Snj . . . , si. Note that the sym- 
metrization of the distribution function J-n{x) is a function J-n{x) which is the empirical 
distribution function of the eigenvalues of the matrix V. By (j2.14p . we have 



F{x) = 1/2(1 + sgn{x} F{x^)) 



(2.14) 




and V = VJ 



A(r)=sup|F^)(x)-G(-)(x)| 



(2.15) 



X 



where Fn"^\x) = 'EiFn{x) and G^"^\x) denotes the symmetrization of the distribution 
function G^"^\x). Let s{z) denote the Stieltjes transform of the random variable and 
let s{z) denote the Stieltjes transform of ^. Then 
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In the what follows we shall consider the symmetrization of the distribution Fn"^\x) 
and the Stieltjes transform of F^\x). We shall omit " ~ " in the notation of the 
distribution function Fn"'\x) {G^'^\x)) and the Stieltjes transform 's"^\za) (s^'"^\z)). 
By C (with an index or without it) we shall denote generic absolute constants, whereas 
C(-, •) will denote positive constants depending on arguments. For every matrix A by 
II A II 2 we shall denote the Hilbert-Schmidt norm of the matrix A and by ||A|| we shall 
denote the operator norm of the matrix A. 

3 The proof of the main result for m = 2 

First, we prove Theorem 1 1.1 1 for m = 2. Introduce the matrices H and J by the equalities 

Let V := H'^J, and R{z) denote the resolvent matrix of V, 

Yi{z) := (V-zI)-^. 

Furthermore, we note that the symmetrization of the distribution function G2{x) has 
a Stieltjes transform s{z) which satisfies the following equation 

1 + zsiz) - zs^{z) =0. (3.2) 

We shall prove that in the case m = 2 the Stieltjes transform of the expected spectral 
distribution function Sn{z) = T^dFn{x) satisfies the equation 

l + zs{z)-zs^{z) = 6n{z), (3.3) 

where Sn{z) denotes some function such that (^„(z) — )• as n — ?■ oo. In the what follows we 
shall denote by en{z) a generic error term such that |en(2)| < Ct^v~^ for some positive 
constants C, a, and b. 

We start from the obvious equality 

l + zsn{z) = ^BTiY-Riz). (3.4) 
Zn 

Using the definition of the matrices V, H and J, we get 

1 " 

^ + ''""^'^ = 2^ ^ ([HJR]., + [HJR]^.^_„^,^„) . (3.5) 

^ j,k=l 

By Lemma 15.71 of the Appendix, we get 

1 A ^ rSHJRl 1 A _ rSHJR" 



2n\fn 



dX. 



jk 



+ £:n{z). 

j+n,k+n 
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Let ei, . . . , e2n be an orthonormal basic of M^". First we note that, for I < j,k < n, 

dH 1 

^ = ^(e,e^ + e.+„eJ^.J, (3.6) 



and 



'eje^+,, + efc+„eJ). (3.7) 



Now we compute the derivatives of the resolvent matrix as follows 

(?n, 1 



1 



- ^RH(ejefc+„ + efe+„e^- )R. 
y n 

and 



5(HJR) _ 1 , „ „T^■D J. xjTO^„ , „ „T 

1 



— ~ ~7^(^J^fc+" + efc+nej )R - -^HJR(ejefc + efc+„e^-+„)HJR 



where 



^ n n 

^1 (^ Ri,j+n + ^ R-i+nj)> 

i=i i=i 

1 " 

^2 := + [HJR]^+n,fc+n)j 

^ n n 

^3 := y^[HJR]jj+.n y^[HJR]fc_|_^^fc, 

j=i k=i 

1 " 

^4 := "■^~2-^ ^ ([HJRH]fcj+„Rfc+„j + [HJRH]j+„^fc+„R 



2n 

^ n n 

k=l j=l 
^ n n 

Aq := — ^[HJRH]fc+„^fc ^ Rj+„j+„. 
k=i j=i 



(3.8) 



- ^HJRH(eje^+„ + e^+^ej )R. (3.9) 
The equalities ()3.5p and p.9p together imply 

l + ZSn{z)=Ai + --- + AQ + en{z), (3.10) 



We prove that the first four summands are negligible and the main asymptotic terms are 
the last two summands. We now start the investigation of these terms. 
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Lemma 3.1. Under conditions of Theorem \l.l\ we have 

n n „ 

In ^-^ n ^-^ nu ^ 

fc=i j=i 

1 " 1 " C 

\A, + {—Y,^[UJRU]k+n,k){-Y.ER,+n,j+n)\ < (3.11) 

fc=l j=l 

Proof. Using Cauchy's inequality we have 

n n 

1^5 + iirY.^ [HJRH]fc,fe+„)(- V E R,j)| (3.12) 



<E3 



k=i j=i 

^ n n 

— (y^[HJRH]fc^fc_i_yt — E y^[HJRH]fc^fc_|_n) 

fc=i fc=i 



1 

E 2 



1 " 



n 



(3.13) 

Applying Lemma 15.41 with p = 2 and (7=1 and Lemma 15.31 (see the Appendix), we get 

n n „ 

I^5 + (^Ee[hJRHK,+„)(-J]er,,)|<^. (3.14) 

fc=l j=l 

Similar we prove the second inequality in ()3.1ip . Thus the Lemma is proved. □ 
Note that 

- ^ERj-j- = - EeRj+„,j+„ = sn{z). (3.15) 

Lemma |3.H equality (j3.15p and the definition of matrix H together imply 

1 " C9 

A5 = -Sn{z)— V BX^k [HJB]j^k+n + (3.16) 

j,k=i 

and similarly 



1 C0 
^6 = -sniz)— ^Xjk [HJR]^.+„,,, + — , (3.17) 

j,k=l 

where 6 denotes a quantity such that \9\ < 1. Applying Lemma 15.71 and equalities ()3.6p - 
(IMD, we get 



1 1 

= -^sl{z) + sliz)— E E [H2jR],., + + Ag, 

i=i 

1 1 " 

^6 = -^4(^) + 4(2)^ E ^ [H'jR]i+nj+n + ^8 + ^10, (3.18) 



2n 



where 



" j=l k=l 



j=l k=l 
1 " 

" j,k=l 
1 

^10 = SnC^)^— 2 ^ [HJRH]j+„^fc+.„Rj^fc_,.„, 



By resolvent equality I + zH = WR, we have 



^ n n 

— (^E [H2jR],,. + [H2jR],.+„,,+„) = 1 + zsn{z). (3.19) 

^ j=i j=i 
Equalities {33]), (|3lB and (f3lB together imply 

A5 + Ae = zsf,{z) + A7 + --- + Aw. (3.20) 

Lemma 3.2. Under the conditions of Theorem \l.l\ we have 

C 

max{|^i|, l^al, |^|, l^iol, |^4|} < (3.21) 

Proof. We shall describe the estimate (j3.2ip for the quantity only. The other bounds 
will be similar. By Holder's inequality, we have 

IAqI < ^E||HJRH||2||R||2 < ^E||HJRH||2||, 

where || • ||2 denotes the Hilbert-Schmidt norm of a matrix. Using 

||HJRH||2 = ||h2jR||2 < ||h2||2||R|| < -HH^Ib, (3.22) 



and Lemma [5TT| we get 



\Ag\ < —3— < 2 

n'2v 



Thus the Lemma is proved. □ 
Introduce the notations 

^ n 1 " 

• " X] ^ [HJR]ji, ^ •= - X] ^ [HJR]j+n,j+n, 



n ^ — ' n 



^ n 1 " " 

j=l j=l j=l 

Using these notations we prove the following 
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Lemma 3.3. The following representations hold 

A = -Sn{z)C - Sn{z)D + e„(z), B = -Sn{z)D - Sn{z)C + Eniz), 

C = -tn{z)D - Sn{z)A + e„(z), D = -tn{z)C - Sn{z)B + e„(z), 
where \en{z)\ < 

Proof. We start with the first equality. By definition of A, we have 



1 

A = — ^ > F, XjkTLk+nj- 



Using Lemma [5771 we get 



A — 2 ^ E Rj+„j_|_„[HJR]fc+n,fc 

j,k=l 



^ n 1 " 

2 E [RH]j+„j+„[JR]fc+„^fc 2 ^ ERj+„^fc[HJR]j+„_fc 

1 " 

2 5^ [R-H]fe+„j[JR]fcj + e„(2;). 

j,k=i 

Applying Lemma 15.41 and 15. 5[ we have 

A = -S„(z)C - Sn{z)D + £n{z). 

The proof of the other relations is similar. 
We may write now 

^3 + ^7 + ^8 = -CD+^Sn{z){BD + AC) = -^{C-Sn{z)B)D-^{D-Sn{z)A)C + e 
Applying the results of Lemma 13. 3|, we obtain 

^3 + ^7 + ^8 = -^iD + Cf - hn{z)CD + Sniz) 

= -1(1 + ^)(Z) + - Un{z){C - Df + Sniz) 

el{z){l + tniz)/4:f eliz) 

~r En\Z)- 



2{l + tn{z)-2sl{z)Y {l-tn{z)f 

Consider first the case u > 4. Here we have 

\Sn{z)\ < ^, \tniz)\ < ^. 
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These inequalities imply that for v > 4 



Ct 

\A-i + AT + As\ < 



(3.23) 
(3.24) 



Inequalities i^JU\i . ^^?M . (IX^ . and i^?2^ together imply 

1 + ZSn{z) = zsl{z) + 5n{z), 

where |(5„(z)| < for v > 4. 

Lemma 3.4. Assuming the conditions of Theorem \l.l\ there exists some positive constants 
Co, Ci such that, for v > Cq, 

Ci\en{z)\ 



\s{z) - Sn{z)\ < 



Proof. First we note that 



1„ 1 



\zSn{z)\ < 1 + -E 2||V||^ 



Applying Lemma |5. II and that max{|s(2;)|, |s„(z)} < v ^, we get 

1 C 

max{\zsl{z)\, \zs{z)sn{z)\} < -(IH ). 



Furthermore, 



It follows from equality ()1.4p that 



Im{zs^(z)} < 0. 



Imzs (z) = Imjz + —-^1 = r~rT^ • 

s[z) |s(-2^)r 

For a Stieltjes transform t{z) of a random variable ^ we have 



v\t{z)\'^ - lmt{z) 



E- 



1 



E 



1 



< 0. 



(3.25) 
(3.26) 

(3.27) 
(3.28) 

(3.29) 
(3.30) 



Equahties I^J^ and (f330]) together imply ([3:28]) . From relations ([13]) and ([gTM]) we 
obtain 



\Sn{z) - s{z)\ < 



(3.31) 



\z — Zs'^{z) — Zs{z)Sniz) — ZS^{z)\ 

Inequalities ([S^ZD, (|3:28]) together imply that, for v > 4C, 
\z — zs'^{z) — zs{z)sn{z) — zs'^{z)\ > lm.{z — zs'^{z) — zs{z)sn{z) — zs'^{z)} > ^. (3.32) 



Inequalities (|3.31|) and (j3.32p together completed the proof of lemma. 



□ 



The last Lemma implies that there exists an open set in C"*" with non-empty interior 
such that Sn{z) convergence to s{z) on this set. The Stieltjes transform of these random 
variables is an analytic function on and locally bounded, that is (|s„(z)| < for any 
■y > 0). By Montel's Theorem (see, for instance, [1], p. 153, Theorem 2.9) s„(z) converges 
to s{z) uniformly on any compact set in the upper half-plane /C C . This implies that 
An — 7- as n — 7- oo. Thus the proof of Theorem 11.11 in the case m = 2 is complete. 
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4 The proof of the main result in general case 

Recall that H and J are defined by the equalities 

H^(o"x°)- (") 

Let V := H"*J, and 'R{z) denote the resolvent matrix of the matrix V, 

R(z) := (V- 

We shall use the following "symmetrization" of a one-sided distribution. Let ^'^ be a 
positive random variable. Define ^ := e^,, where e denotes a Rademacher random variable 
with Pr{e = ±1} = 1/2 which is independent of ^. We apply this symmetrization to 
the distribution of the singular values of the matrix X^. Note that the symmetrized 
distribution function Fn{x) satisfies the equation 

= 1/2(1 + sgn{x}F„(x2)), 

and that this function is the empirical spectral distribution function of the random matrix 

O X'" \ 

X*™ o ) ■ 

Furthermore, note that the symmetrization of the distribution function G{x) has the 
Stieltjes transform s(z) which satisfies the following equation 

1 + zs{z) + (-l)""+iz""-is™+^(z) = 0. (4.2) 

In the rest of paper we shall prove that the Stieltjes transform of the expected spectral 
distribution function s„(z) = -^^dE Fn{x) satisfies the equation 

1 + ZSniz) + {-ir+^z"'-h^+\z) = 6niz), (4.3) 

where Sn{z) denotes some remainder function such that 6n{z) — t- as n — )• oo. 
We start from the obvious equality 

l + zSn{z) = ^TTYK{z). (4.4) 
2n 

Using the definition of the matrices V, H and J, we get 

1 " 

1 + ZSniz) = E^Jfc ([H'"-'JR]fcj + [H— ijR],+„,fc+„) . (4.5) 

"^^"^ j,k=i 

In order to simplify the calculations we shall assume that Xjk are i.i.d. Gaussian random 
variables, and shall use the following well-known equality for a Gaussian r.v. ^ 

EC/(0 = E/'(0, (4.6) 
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which holds for arbitrary differentiable functions f{x), such that both sides are defined. 
By Lemma 15. 7| we obtain that the error of the replacement by Gaussian r.v is of order 
0(r„). In the what follows we shall use the notation en{z) for functions satisfying |en(-2)| < 
Ct^v~^, for some positive constants a,b, and C. Let ei, . . . ,e2n denote an orthonormal 
basis of M^". First we note that 

^ = ^(e,e- + e,^„eJ^J. (4.7) 
Now we may write the equality for the derivatives of the matrix H'""^ JR as follows 



I JXV, 1 T I „ T \-rim-2~q -f-r, 

^ m—l 

- H— 1 JRH'^le.e^ + efc+^eJ^jH— ^'^JR. (4.8) 



g=0 

The equalities (j4.5p and (j4.8p together imply 

1 + zsn{z) = Ai + A2 + Bi + B2 + C1 + C2 + Di + D2 + e„(z), (4.9) 



where 



m — 2 n 

^1 ■■=Y.^^T. H^,[H-"^-JR].„ 



g=0 j,k=l 



m—2 ^ n 



2n2 

9=0 j,k=l 
m—l ^ n 

^1 ^= - E 5] [H-ijRH'^],,[H-i-'^JR],,, 

g=0 j,k=l 
m—l n 

i?2 = - E E [-f^™ "^JRH™ '']fc,fc+n[H'" "^JRjj+nj, 
<?=0 fcj=l 
m-2 ^ 

^1 = E ^EH^_^„ ;,_^„[H""-^-«JR]j+„,fc+„, 

9=0 

m—2 ^ n 

^2 - E 5; H^V„,^.[H-2-JR],,,+„ 

g=0 j,fc=l 
m—l ^ n 

-C'l := - E 2ri?^ ^ "'"JR'H^]j+n,A;+n[H'" ^ '^JR]j+,i,fc+n 

g=0 j,k=l 
m—l n 

D2 = - E E [-f^™ ^JRH"* ^ '^]j_(.„j[H'" ^JR]fc^fc_|_„. 

9=0 fcj = l 
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Lemma 4.1. Under the conditions of Theorem \ 1 . 1\ there exists a constant C > that the 
following inequality holds 

(J 

maxiUil, \Bi\ |Ci|, \Di\} < —. (4.10) 

nv 

Proof To prove this lemma it is enough to use Holder's inequality and Lemma lS.ll in the 
Appendix. □ 

Lemma 4.2. Under the conditions of Theorem \l.l\ we have 

A2 = C2 = 0. (4.11) 

Proof. The claim follows immediately from the equality H^j_|_^ = 0. 

□ 

To investigate the asymptotic behavior of B2 and D2 we introduce the notations 

^ n 1 " 

fa,j3 '■= — ^ E [H°JRH'']jj+„, Qa^p := — ^ E [H^JRH^^Jj+^j, 

^ i=i ^ i=i 

^ n 1 " 

ta ■= — ^ E [H"JR]j,j, Ua ■= — ^ E [H"JR]j+„j+„ 

We prove the following 

Lemma 4.3. Assuming the conditions of Theorem there exists constant C > such 
that the following inequality holds 

m-l ^ 

I-B2 + ^ fm-l,qgm-l-qfi\ < —4, 
q=Q 

m—l ^ 

I-D2 + fi'm-l,g/m-l-<7,o| < 7- (4.12) 

Proof. Consider the first inequality. Applying Holder's inequality, we get 

m—l 
\B2 + /m 

m—l 



^ E E^I^E([H™-^JRH'?],,,+n -E X;[H-ijRH''],,,+.)|2 

9=0 i=l i=l 

X E^|-E([H™-i-''JR],-+„„, -E[H™-i-™],+„ 



To conclude the proof of Lemma it is enough to use Lemmas 15.31 and 15. 4[ The proof of 
the second inequality is similar. Thus the Lemma is proved. □ 
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Note that 

^ n 1 

/oo = 900 = — ^ E Rjj = — ^ E Rj+.„j+„ = Sn{z). (4-13) 



n — ' n 



By Lemma 14.31 and equality (j4.13p . we may write 

B2 + D2 = --Sn{z){fm-l,m-l + ffm-l.m-l) 



m-2 

-Ij^^m-l-gjO + 9m-l,qfm-l-g,o) + ^nl^)- (4-14) 

g=0 

We consider now the behavior of the coefficients ^o,/?, and Uo, for a, /3 = 0, . . . , m — 
1. Applying Lemmas 15.71 and 15.41 we obtain the following relation for a > 0, /3 > 

m—l 

fa, (3 ~ ^ '] fa—l,qim— l+l3-q + fa-l,l3-l+ ^niz). (4.15) 
q=0 

It is straightforward to check that for q > m the following relation holds 

^ n \ ^ 

tq = - J^[H9]j+n,i+„ + Z- Y,['H''~""'R]j+n,j+n = Sg + zfg.^^Q + e„(z), (4.16) 

^ i=i i=i 

where (5o = 1 and 5g = for q > 0. Using relation (j4.16p . we may rewrite (j4.15p in the 
following form 

13-1 m-1 

fa, (5 = —Z E fa~l,qfl3~l-~q,0 — ^ fa~l,qUrn-l+l3-q + l^n{z). (4-17) 
q=0 q=l3 

For /3 = 0, we get 

m— 1 

/a,0 = - E fa-l,qUm-l-q + £n{z). (4-18) 
q=0 

Similar we obtain 

P-l m-l 

ffa,/? = 9a^l,q9l3-l-q,0 " 9a-l,qtm-l+l3-q + en(2;)- (4.19) 

(?=0 g=a 

and 

m— 1 

50,0 = - X] 9a-l,qtm-l-q + en(2;)- (4.20) 

Applying Lemmas l5.7l and l5.41 we obtain a similar relation for Ua and t^, for a = 0, . . . , m— 
1. 

m-2 

Ua = — /a-l,m-l5'0,0 " ^ fa-l,q9m~l-q,0 + £n{z), (4-21) 
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and 



t. 



m-2 

a — -9a-l,rn-lfo,0 - ^ ga-l,q frn-l-q,0 + £n{z). 
q=0 



(4.22) 



Denote by F (resp. G) am— Ixm — 1 matrix with entries Fp^q = (resp. 
Gp,g = gp-i,g-i), p,q = 1 ... ,171. Let t (resp. u) denote a vector-column {ti, . . . , tm-i)'^ 

(resp (ui, . . . ,n„-l)^). Let f« = (fafi, , ■ ■ ■ , fa,a-l,0, fa,a+l, ■ ■ ■ , fa,m-lV ^nd ga = 

{ga,o, ■ ■ . ,ga,a-i,0,ga,a+i, ■ ■ ■ , ga,m-iV , for ct = 0, . . . , m - 2. Introduce the matrices 



and 



Let 





( 


-Uo - Ui 




Um—3 


-Um-2 \ 






-2/0,0 - -"0 




Um 


-4 


- Um~2 




\ 


- zfm-2,0 


zfm- 


-3,0 • 




- 2/0,0 - ^^0 / 




( 


—to — ti 




tm 


-3 


- tm-2 ^ 


Mt = 




-zgo,o - to 




~ t-m- 


-4 


— tra-2 




\ 


- zgm-2,0 


zgm- 


-3,0 • 




- zgofi - to J 






/oo.. 


01\ 










00.. 


10 








L = 










[10.. 


00/ 







We introduce as well the vectors yo = (— /o,q-i, • • • , — /o,!, 0, —2/0,1, . . . , —zfm-a,o)'^ and 
Wa = {-go,a-i, -50,1, 0, -250,1, • • • , -zgm-afiV- We shah denote by r.„ quantities 
such that ||r.„(2)|| < 

Using these notations we may rewrite the relations ()4.19p - (|4.22p as follows, for a = 
1, . . . ,m, 

~l~ I"n(2), fa — fa— 1,0-iya + MuLfQ,_i -I- Yn{z), (4.23) 

and 

t = -s„(2;)fm-i + FLfo-Fr„(2), u = -s„(2)gm_i + GLgo + r„(z). (4.24) 

Furthermore, we may represent the relations (|4.18p and (j4.20p as follows 

fo = -uofm-i + FLu + Tn{z), go = -togm-1 + GLt + r„(z). (4.25) 

Lemma 4.4. Under the conditions of Theorem \l.l\ there exists a sufficiently large constant 
Vo such that for any v >Vo we have 



max{||u||, ||t||, 11411, ||gc,||} < 



CTn 
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Proof. First we note that, for z = u + iv such that v > 

||w,|| + ||y«|| <C(||fo|| + ||go||). (4.26) 
Furthermore, by Lemma 15.21 and inequahty ||R|| < v~^, we have 

max{||F||,||G||}<^. 
It is straightforward to check that 

max{\zfc,^p\, \zga,p\} < Cm{l + -)• 

V 

The last inequahties imply that 

1. 



max{||M„||,||M<||}<C^(l + 



V 



Relations ([iT^ . ([O^ together imply that 



|u|| + ||t|| < ^(||f„^-l|| + ||gm-l||) + ||rn(^)||. (4.27) 



Relation (j4.23p implies that 



„ m—l 



||g™-i|| + ||f™-i|| < Edl^^ll + + ^(IISoll + llfoll) + \\rniz)\\. 

9=1 

Applying now inequality (j4.26p . we get 

||g„_i|| + ||f^_i|| < C^dlfoll + llgoll) + \\rniz)\\. (4.28) 
Furthermore, relation (|4.25p implies that 

llfoll + llgoll < ^(l|gm-l|| + ||fn^-l||) + ^(||u|| + ||t||) + \\rn{z)\\. (4.29) 

Inequalities KTlh . (fOHjl . (109]) together imply 

||g^_i|| + ||f™_i|| < — (||g^_i|| + ||fr„-i||) + ||r„(z)||. (4.30) 

V 

Cm ^ 1 



Choosing vq such that ^ < 4, we obtain 



|gm-i|| + ||f«-i||<^. (4.31) 



Relation (|4.27p implies now that 

CmTn 



U + t < 4 . 
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From relation (|4.26p it follows that 



Similar to inequality ()4.3ip we get 



I II I 111? II ^ 

ga + fa < 



Thus the Lemma is proved. 



□ 



Lemma 4.5. Under the conditions of Theorem \l.l\ we have 

fa,a = -zs{z)fa-l,a-l +£n{z). (4.32) 

and 

ga,a = -zs{z)ga-l,a-l + £niz). (4.33) 

Proof. We shall consider the first equality only, the proof of the other one being similar. 
By relation (j4.17p . we have 

a— 2 m—1 

fa,a = —zfoflfa-l,a-l — fa-l,qfa-l-q,0 — ^ fa-l,qUm.~l+l3~q + £n{z). (4.34) 

q=0 q=a 

This equality implies that 

fa,a = -zs{z)fa^i^a~l + 6*1 z| || f„_l || || fo || + Eniz). (4.35) 

Applying Lemma 14.41 we conclude the proof. □ 
Equality (|4.14p and Lemma 14.51 together imply 

1 + ZSn{z) = -S{z){fm-l,m-l + <7m-l,m-l) + en{z) = {-ir Z^^-^^+^z) + e„(z) (4.36) 

We rewrite that last equation as follows 

1 + ZSn{z) + {-ir-'z^-h::+\z) = Sniz) (4.37) 

The Stieltjes transform s{z) satisfies the equation 

1 + zsiz) + (-l)"*-iz""-is™+i(z) = (4.38) 
The last two relations together imply that, for v >Vo 
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Note that 

max{|zs(z)|, \zsn{z)\} < C{1 + -) (4.40) 

V 

and 

max{|s„(z)|, \siz)\} < - (4.41) 

V 



Applying these inequahty, we obtain 



C 



|(-z)™-^^s'^(2)C-^(z)|<^. (4.42) 

q=0 



We may choose Vi >Vo such that for any v >Vi 



7 ^ i' f^'^) 

This imphes that for v >Vi 

m 

+ (_^)— 1 J2 s^{z)s^-'^{z)}\ > I (4.44) 

and 

\sn{z)-s{z)\<^. (4.45) 

From inequahty (|4.45p we conclude that there exists an open set with non-empty interior 
such that Sn{_z) converges to si^z) on this set. The Stieltjes transform of these random 
variables is an analytic function on and locally bounded (|s„(2;)| < for any > 0). 
By Montel's Theorem (see, for instance, [1], p. 153, Theorem 2.9) the convergence of s„(z) 
to s(z) is uniform on any compact set in the upper half-plane /C C C"*". This implies that 
A„ — )■ as n — 7- oo. Thus the proof of Theorem 11.11 in the general case is complete. 

5 Appendix 

5.1 Frobenius norms of powers of truncated matrices 

Recall that we consider truncated independent random variable satisfying 

|EXjfc|<^, E|X,-fc|2 = 1 + ^f^, |Xjfc|<r„V^, (5.1) 

where t„ — >• as n — )• oo converges to zero as slowly as needed. 

We would like to investigate the behavior of the Frobenius norm of powers ||X™ ||2 of 
the random matrix X = ■^(Xjfc)"^^^^. We formulate the following 
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(n) 

Lemma 5.1. Let X-j^ he independent random variables for 1 < j,k < n and assume that 
l\5.1\) holds. Then for any m > 1 and any v = 0, . . . ,m, there exists a constant Cm > 
depending on m such that 

E||X'^(X- EX)'"-nii < <^mn. (5.2) 

Proof. We start with the case u = 0. Consider the matrix X := X — EX = -^(Xjk)J j^^^^ 
and the norms of the powers of this matrix. We may write 

n n n 

E IIXII2 = n""* X] X^ ^^jh^hh • • • ^3m-2jra-l^jm-lk 

j,k = ljl,...,jm-l=lj[,...,j'„^^^=l 

X~^i X ,jr ■ ■ ■ X ,:' X ~f u. (5.3) 

JJl JlJ'Z Jm-2Jm-l Jm-l'^ ^ ' 

Here for any number a = u + yj—lv, a = u — \/—lv denotes the complex conjugate. 
The product in the right hand side of ()5.3p involves /i different (with respect to complex 
conjugates) terms, say X^^ ;')•••) -^f^ v 1 with multiplicities mi, . . . , m^, where e = it and 



^Xjk, if e ^ 



Note that mi + • • • + = 2m and if min{mi, . . . , m^} = 1 then expectation of corre- 
sponding product equals since EX?j = for any j,l = 1, . . . ,n. This implies that non 
zero terms occur for ^ < m and minjmi, . . . , rra^} > 2 only. By assumption (jS.ip . we have 

IE Xii-, Xj, ■ ■ ■ X-j 1^1™ Tk-Xi^' X Ai ^1 ■ ■ ■ X ^1 ^1 X i/ ul < ^T^y^" ^\ 

I JJl J1J2 Jm-2Jm-l Jm-lt J]-^ Jj^Jj Jm-2Jm-l Jm-l'^' ~ ^ 

(5.5) 

The cardinality M{li, . . . , Im, I'l, ■ ■ ■ , I'm) of the set of indices with n different edges li,, 
and multiplicities mi, . . . , m^ respectively satisfies the inequality 

M{h,...,lm,l'i,---,l'm)<Cnf'^'- (5-6) 
The representation ()5.3p and the inequalities (15.51 and (15. 6p together imply 

E||X™||1 <C^n (5.7) 
Assume now that 1 < ly < m. Consider the quantity 

4"^) =E||X'^(X-EX)'^-nii. (5.8) 
Let A = E X. It is straightforward to check that 

V 

< Cm XI (E l|A||^)"E ||(X - A)™""||2. (5.9) 

0=0 
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To prove (|5.9p we consider the representation 

X'^ = ^*A"^i(X - A)'"! • • • A™''(X - A)'"^ (5.10) 

where ^* stands for sum over ah indices mi, . . . , mk,m'i, . . . , m'^ > such that 
mi + • • • + rriy + jn'^ + • • • + m'^^ = v. This imphes the bound 

r^T^ < C™J^*E ||A'"i(X - A)™'i • • • A"'^(X - A)"^'"!!!- (5-ll) 

Using that for any matrices A and B we have ||AB||2 = ||BA||2 and that ||A''||2 < ||A||2, 
we get from this inequahty the bound (|5.9p . By assumption (|5.ip . we have 

n » 1,2 CM 

IIAIIB^. (5.12) 

Inequahties (jS.lip , (|5.12p , (j5.7p and the induction assumption together conclude the proof 
of the Lemma. 

□ 

We shall use the following obvious bounds 

in) 

Lemma 5.2. Let X-^ he independent random variables for 1 < j,k < n. assume that 
( I5. 1\) holds and that EXj^ = 0. Then for any m,r > 1 and any v = 0, . . . ,m, and any 
j = 1, . . . ,n, there exists a constant C{m,r) > depending on m, r such that 

maxjEllX'^ejIll'', E ||ejx''||^''} < C(m,r). (5.13) 

Proof Let 

= ||X^ej||2. (5.14) 

We may write 

n n n n 

r;.,= EE E E 

kl,...,kr = l .(1) ,-(1) _i .(1)' .(1) ,M ,(--) 



X 



n r ^ ^ 



Ar)' At) '_ 5 = 1 



(5.15) 



where 

A{k„j^^\...,j^^\) = X (,) X,,) (5.16) 

Assume that the set of indices M = Ug^]^{{/cg, . . . , j^li}^ j^i^ , ■ ■ ■ } consists of 
different pairs, say . . . , l^, l'^, with multiplicities mi, . . . , m^ respectively. Note that 
mi + • • • + m^ = 2qr and if minjmi, . . . , m^} = 1 then the corresponding term equals 0, 



21 



since EXj^i = for any j, / = 1, . . . , n. This implies that < m and minjmi, . . . , m^} > 2. 
By assumption ()5.ip . we have 

\BA{kg,j['^\. . . jj^)', . . . , < C(r„V^)2™--2^ (5.17) 

The cardinahty . . . , /m, ^'i, • • • , ^m) of the set of indices with n different edges li,, 1^ 

and multiphcities mi , . . . , satisfies the inequahty 

^^{h,...,lrrJl....^'m)<Cn^'. (5.18) 

The representation (j5.3p and the inequahties (|5.17l and ()5.18p together imply 

E llX'^ej llf < C(?n,r) (5.19) 
The bound of E ||eJX''||2'' is similar. Thus, lemma is proved. □ 
Lemma 5.3. Under the conditions of Theorem \l.l\ we have 

E|i(TrR- ETrR)P < (5.20) 

n nv^ 

Proof. Consider the matrix X^-'^ obtained from the matrix X by replacing the entries of 
the j-th row by zeros. We define the following matrices 

"'■"={o"j')- fi"'=H«)j, (5,21) 

We shall use the following inequality. For any Hermitian matrix A and B with spectral 
distribution function Fa{x) and Fb{x) respectively, we have 

|TV(A - zl)-' -Tt{B- zI)-'\ < (5.22) 

V 

It is straightforward to show that 

rank(H«J - H^-^'^^J) < 4g. (5.23) 
Inequalities (|5.22p and (j5.23p together imply 

I — (TrR - TrR(j'))| < — . (5.24) 
2n nv 

After this remark we may apply a well-known martingale expansion techniques suggested 
already by Girko [5]. We may introduce cr-algebras J^j = (T{X/fc, j < I < n, k = 1, . . . ,n} 
and use the representation 

m n 

TrR - ETrR = ^ ^(Ej_iTrR - EjTrR), 
where Ej denotes conditional expectation given cj-algebra J-j. □ 
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Lemma 5.4. Under the conditions of Theorem li.il we have, for q>l 

1 " " C 

E |-(^[H''JR],,+„, - E J][H'?JR],-,+„)p < — . (5.25) 
n ^-^ ^-^ nu^ 

Proof. We introduce the matrices X'^-'^ = X— e^ejx, and H^-'^ = H— ejejH— Hej+.„eJ^„. 

Note that the matrix X'^-'^ is obtained from the matrix X by replacing the entries of the 
j-th row by 0. Consider the quantity 

n n 

Sj := Y,[^'J^]kk+n - Y.l^^'^'^^^^k+n- (5.26) 

k=l k=l 

Using equality 

q-l 

H''JR - h(J')^JR(J) = H(J')''(H - h(^'))H''-i-'^JR 

iy=0 
p-1 

+ h(J')'^JR(^')h^(H - U^^'^)UP^^-''3-R, (5.27) 

iy=0 



we get 



where 



Sj = sf + Sf, (5.28) 



q—l n 

:(i) 



Sj = E EfH^^'^'^lH - hW)H'^-i-JR],,+„ 



!^ = fc = l 

p-1 n 
:(2) _V-V-rTT(j)5- 



!/ = fc = l 

Applying now that 



Sf =^ ^[h(^')''jr(-'')h'^(H - U^^^)UP-^-'JB,]kk+n- (5.29) 

;=1 

H - H(J') = ejejn + Hej+„eJ+„, (5.30) 



we obtain 

n 

^[h(^')'(H - H(^'))H'?-i-'^JR],,fc+„ = TV JH(j')'(e,-ejH + He^.+^eJ+jH^-i-'^JR 
fc=i 

= [H^-''JRJH(J'''']jj + [H'^^i-'^JRJH(^')''h]j+„j+„|. (5.31) 

Here 
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Equality ()5.3ip implies that 



q-l 

\sf\ < |[H''-'^JRJH(^')"],-,| + |[H«-i-'^JRJH(J')"h],-+„,+„|. (5.33) 

u=0 



Using Holder's inequality, we get 



E|5f)p <^^J2(^\\eJn^-'^\\l\\u(^re,g (5.34) 



u=0 



Lemma 15.21 and Holder's inequality together imply 



V 

Similar we get 



E|5f^|<-^. (5.35) 



E|5f|2<^. (5.36) 



C 



Inequalities (|5.35p and (|5.36p together imply 

E|5,p<^^^. (5.37) 

Let denote the cr-algebra generated by X;/;, for 1 < ^ < j, 1 < A; < n. Denote by 
Ej the conditional expectation with respect to cr-algebra Fj. We may write 



E |-( j;[H''JR],,+„ - E J][H™],-,+„)P 

^ n n n 

= — ^ E |Ej ^[H^JR]yfcfc+„ - E j_i y^[H''JR]fcfc_|_^)p 

j=l k=l k=l 

^ n n n 

^ - E E I Y.^^'^^^kk+n - j;[H0-)''jR(^-)]fcfc+„)|2 



j=l k=l k=l 

< (5.38) 

Thus the Lemma is proved. □ 
Lemma 5.5. Under the conditions of Theorem the following inequality holds 

C 



^\^ii2^3,J+n-B^K,,+r^)\' < -4. (5.39) 



n ^ — ' ^ — ' nv^ 

i=i j=i 
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Proof. The proof is similar to the proof of the previous lemma. We have 

n n P~l n 

^R,,+.-^Rg^„ = 5; j;[R(^-)H(^-)^(e,-ejH + He,+„eJ+Jff-i-^R]fc,+„. (5.40) 
k=l k=l iy=0 k=l 

Applying Holder's inequality and inequality max{||R||, ||R'^-'^||} < v^^, we get 



1 



p-i 



k=l 



(j) I < _ 
'fcfc+nl — y2 

k=l 1^=0 



p-1 



TttP-iv| 



+ ,,2 X] 11^1+"^ 



(5.41) 



Using Holder inequality and Lemma [521 we get 



E I J] Rfcfe+n - Yl ^fefc+nl^ - 



(i) |2 ^ ^Jim 
,4 ■ 



(5.42) 



k=l 



k=l 



To conclude the proof it is enough to use the martingale expansion of the difference 
Ylk=i Rkk+n - Ylk=i^ ^kk+n similar to previous lemma. 



□ 



Lemma 5.6. Under the conditions of Theorem \l.l\ we have, for < fi, 1^ < m, that there 
exists a constant Cm depending on m such that 



_ 3 
n 2 



J2 ^{Xjk + X. 

j,k=i 



jk) 



5^(H^JRH^ 

9^]k 



'^jkXjk) 



kj 



< 



(5.43) 



where 9jk and Xjk are mutually independent j,k = 1, . . . , n, and 6jk are uniformly dis- 
tributed on the unit interval. By ^ •j. A{6jkXjk) we denote the matrix obtained from 



92 



jk 



by replacing the entries Xjf^ by OjkXj^. 



Proof. By the formula for derivatives of a resolvent matrix , we have 



ax 7^ + efc+„eJ+jH-i-JRH/^ 

-. m— 1 

--rY. H'^JRH''(e,e^ + e^+^ej; JH^^^-^JRH 
^'^ 6=0 



(m) 



(5.44) 



c=0 



25 



From this formula it follows that 



n — ' — ' " ^ — ' — ' ° ' n 

J« a=0 i=l c=l i=l b=l i=\ 



where 

a-l 



s=0 

^ i/— a— 1 

P?^ = — E H"(e,e^ + efc+„ej;jff(e,e^ + efc+„eJ+jH--i-»-^JRH^ 

^ m— 1 
1 ''"^ 



s=0 

Furthermore, 





1 ''"^ 

-Y^ H^(e,e^ + efc+„ej+ JH'^-I-^ JRH^(e,ef + e,^ 

s=0 




rT.(c) _ 

-■-2 — 


^ m— 1 


rp(c) _ 

-■-3 — 


1 ''"^ 
s=0 


.„ej;jH^-i- 


rTn(c) _ 

^4 — 


11-2-c 

- H^JRH^(e,-e^ + efc+„eJ+„)ff(e,-e^ + efc+„ej; 

s=l 





(5.46) 
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Finally, 



s=0 
m—1 

s=0 
6-1 

U^') = -Y. H'^JRff (e,e^ + efc+„ej; jH^-i-^(e,e^ + e,+„ej; jH-^^-^JRH'^ 

s=0 
6-1 

Uf = - ^H'^JRH^le.-e^ + efc+,ej+jff(e,-e^ + efc+„eJ+jH™-2-6jj^jj/. 

s=0 

m—1 

U^') = - ^ H'^JRH^(e,e^ + e^+^ej^ JH^ ^-^JRff (e,e^ + efc+^eJ+jH^'i-^JRH^ 

s=0 

= -Yl H-JRH^(e,e^ + e^+^ej; JH— ^-^JRff (e,e^ + e^+^eJ+jH^-i-^ 

s=0 

Note that for any matrices A and B we have 

|[AB],fc| < ||e^A||2||Ae,-||2. (5.47) 
Applying Holder's inequality, we get, for a = 1 or a = 3 

E\X,kn[P^%j\ < Ef |X,-fc|4E^|[p('^)]fc,|^. (5.48) 
We may use now inequality (I5.47P and Lemma [5. 2 1 to obtain the bound, for a = 1 or a = 3 



4f;E|x,,n[P{%.|<^'^ 

Similar we get 



(5.49) 



4EE|^..n[T,%|<^^ (5.50) 



and 



J:e|X,,|3|[uS%.|<^(^ (5.51) 
Inequalities (|5.49p - (j5.5ip together conclude the proof of the Lemma. □ 



Lemma 5.7. Under conditions of Theorem \l.l\ we have, for /i, > and for any positive 
7] > that there exists a constant C(/Lt,z/, r/) depending on ^,^,1] such that 

± E X,,[H-JRH"1„ = ± E [^a^^l,, + (5,52) 

J,k=l J,fe=l 
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where 9 denotes a function that 



< 1. 



Proof. Let ^ be random variable with = 0, E^^'^ = 1 and let f{x) denote a function 
which satisfies the following condition E |^|^|/" < x. Here 6 denotes a uniformly 
distributed random variable on [0, 1]. By Tailor's formula we have 



Ec/(o = E/'(e) - Ee/"(0e) + ^Bffieo, 



(5.53) 



where 6 denotes a uniformly distributed random variable independent of Applying this 
formula twice and Holder's inequality, we get 



ix:ex,,[h-jrh%.-x:e[ ^("^™^ 

j,k=l j,k=l 



<n-i ^ B{\Xjk\ + \Xjkf) 
j,k=i 



{9jkX 



jk) 



kj 



(5.54) 



Applying now the result of Lemma 15.6^ we conclude the proof of Lemma. 



□ 
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